DOCUMENT 



RESUME 



ED 029 625 1^6 

By* Israel. Jack W. 

Innovation in Evaluation: Teacher Assessment by Objectives. 

Pub Date 18 Mar 69 
Note-29p. 

EDRS Price MF-$0.25 HC-$1.55 

Descriptors-^Evaluation Methods, •Junior Colleges, •Learning. •Teacher Evaluation 

If education is meant to change students* attitudes and actions, good teaching 
must be defined to achieve this goal and to improve Instruction. Evaluation allows the 
teacher to identify his goals with those of the Institution and to know the status of 
his skills, attitudes, and knowledge In relation to it. Sound evaluation makes goal 
achievement more effective by identifying strengths to be reinforced and weaknesses 
to be corrected. The literature covers various ways to observe and assess teachers; 
the author offers a proposal based on their common elements. It combines selected 
goals for the learner and an assessment of the attributes of the teacher The goals 
must be developed cooperatively by teacher and administrator, for. without 
agreement on those, they can have no agreement on procedures or judgments, or on 
acceptable evidence of the teacher’s success in reaching the goals of learner 
behavior. The teacher’s skills, attitudes, and knowledge must remain flexible, to be 
adjusted or modified as required, helping him to develop over time and to seek advice 
more readily. If acceptable evidence of student attainment is predetermined, judgment 
will shift from procedures to results and, with constant modification and clarification, 
evaluation will become more precise. Since, in some cases, teachers may feel 
threatened and oppose this plan, the author describes three alternative ways of 
implementing it. The methods vary in both philosophy and organization. (HH) 



Td 6^6 EDO 29625 



U.S. DEPARTMENT OF HEALTH, EDUCATION & WELFARE 
OFFICE OF EDUCATION 



THIS DOCUMENT HAS BEEN REPRODUCED EXACTLY AS RECEIVED FROM THE 
PERSON OR ORGANIZATION ORIGINATING IT. POINTS OF VIEW OR OPINIONS 
STATED DO NOT NECESSARILY REPRESENT OFFICIAL OFFICE OF EDUCATION 
POSITION OR POLICY. 



INNOVATION IN; EVALUATION; 



TEACHER ASSESSMENT BY OBJECTIVES 



Submitted in Partial 
Fulfillment of the Requirements 
of Education i 4-31 
for 

Dr. Arthur M. Cohen 



By 

Jack W. Israel 



UNIVERSITY Or CALIF 
LOS AMGELES 



March 18, 1969 



APR 1 8 1969 



CLEARiNGHOUSE FOR 
JUNIOR COLLEGE 




t;jble op contents 



Chapter Page 

I. Introduction . 1 

II. P-urposos of Evaluation 2 

III. Probloms in Evaluation k- 

IV. Contributions to the Piold of Evaluo.tion ..... 7 

V. Proposal for an Evaluation Teclinique 12 

VI. Alternative Ilothods of Impleraentation 1$ 

VII. SuTiiinary 2I4. 

Bibliography 25 



I. Introduction 



In the world in which we live and work, it is becoming 
increasingly important that the performance of the individual 
be evaluated as it relates to the goals of the organization 
he serves. Good defines evaluation as the ’’consideration of 
evidence in the light of value standards and in terms of the 
particular situation and the goals which the group or individ- 
ual is striving to attain (ll+). This suggests, for the field 
of education, a necessity to find out what good teaching is. 

It is in this context that evaluation assumes a role of great 
importance. 

This paper will deal with the purposes of evaluation, the 
difficulties involved in evaluation of employee performance, the 
contributions of writers in the field to the problem of evalua- 
tion, a proposal of a method of evaluation for the appraisal of 
teacher performance, and the proposal of three alternative 
methods for implementing a proposed method of evaluation. It 
is the intent of this paper to present differing views as ex- 
pressed by a variety of writers from many different fields of' 
specialty. Prom this diversity of opinion will be. sought threads 
of continuity that emerge and which may form the basis upon which 
an evaluation proposal can be built. 
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II, Purposes of Evaluation 



Evaluation in some form is present in all organizations 
because any activity with purposes logically demands an assess- 
ment of the degree to which the purposes are being met and the 
effectiveness of the means which are being employed to achieve 
the purposes. Pax-zcett says that ‘'evaluation of personnel in 
an organization is essential to the accomplishment of its 
goals (12). “ Bloom states a major assumption of evaluation 
that must be mades Education exists for the purpose of chang- 
ing the thoughts, feelings, and actions of students so that the 
students are different as a result of their experiences, and 
evaluation is conducted to appraise the extent to which the' 
teacher is producing these changes in students (6). It may be 
said from this premise that it is imperative that the field of 
education determine what good teaching is in order that the 
goals of education may be achieved and improved instruction in 
the classroom may result. 

McNeil points out that more than one-half of the nation’s 
teachers report no confidence in their school system’s program 
of teacher evaluation (21) . This feeling is complicated by the 
teacher’s need to be evaluated in order to identify his goals 
with the goals of the organization. Inj order to do this, he 
wants to knovj the status of his skills^ attitudes, and knowl- 
edge as they relate to the organization. Odiorne states that 
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’‘effective appraisal of a maji’s perforraance and potential will 
improve his effectiveness (22).’' 

In addition to the identification of a teacher’s goals with 
the goals of the organization, good personnel practices dictate 
that satisfactory evaluation of teacher quality is mandatory for 
effectiveness. Evaluation must be the basis for systematic and 
eqviitable personnel decisions and administrative actions. 
McGregor proposes that the personnel evaluation program should 
meet three needs: (a.) provide systematic judgments to back up 

S8.1ary increases, promotions, transfers, and sometimes demotions 
or termineitions , (b) provide a means of telling a subordinate 
how he is doing and suggesting needed changes in his behavior, 
attitudes, skills, or knowledge, (c) provide a basis for coim- 
.seling the individual in reinforcement or redirection of his 
behavior (20). Stahl maintains that if the evaluation proce- 
dure is to have the effect of achieving the organization’s 
goals, it must be done in a manner that seeks to maintain or 
improve the person’s performance and that assures reasonable 
equity and dignity in human relationships (27) • 

It seems to be generally agreed that an effective program 
of evaluation should improve the effectiveness of goal achieve- 
ment. This involves seeing that strengths are discovered and 
maintained and that weaknesses are identified and minimized or 
eliminated. This process may lead to modification of goals or 
purposes, may result in better decisions and plans for achiev- 
ing the goals, and may culminate in more effective contributions 
by the members of the organization. 
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III. Problems in Evo.luation 



i/riters in tb.G field, liave pointed out that there are many 
specific problems involved in the coriimon methods of evaluation: 
rating forms^ teacher behavior^ teacher characteristics ^ and 
pupil gain. These problems are divided into two categories by 
Odiorne. One category is called the halo effect. In this 
category the evaluator has a tendency to evaluate the employee 
on the basis of past record^ compatibility ^ no coiiiplaints bias^ 
and effect of past record. In the h^rpercritical category, on 
the other hand, the evaluator is likely to be influenced by the 
employee’s being a meraber of a weak team, by his own sense of 
perfectionism, by an employee who is different or a maverick, 
or by a self-comparison with the employee (22). It seems evi- 
dent that the problems encountered are very real and that 
continued re search is needed which will provide management with 
the skills necessary to use evaluation as a means for reaching 

the objectives of the organization. 

Nuiiierous attempts to predict teacher effectiveness have 
reached a dead end because of problems encountered in develop- 
ing a suitable criterion by which to measure that effectiveness. 
Good’s definition has within it areas which cause considerable 
concern. Uhat evidence is to be considered and in light of 
what value standards? Accepting the premise that -teacher com- 
petence should be measured in terms of pupil growth, many 
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researcliors have spent uncountable hoLirs minutely analyzing 
teacher performance in the classroom. Sorenson points out that 
to attempt to define teaching success in terms of some single 
fixed teacher-ideal is both imtenable and inappropriate. Dif- 
ferences in educational values inevitably mean differences in 
who.t tea.chers arc expected to do. As a result, teachers arc 
bound to be regarded differently by persons with varying con- 
cepts of the teacher's role (26). Popham proposes that many 
raters are concerned x-Jith only the instructional means the 
teacher employs, without any consideration of the ends the 
teacher is trying to achieve. In this ce.se, the teacher may 
be seen in light of the evaluator's personal standards regard- 
ing what form classroom activities should take (23)* 

The problems in evaluation of teacher performance have 
led Lxicio to state that the methods cvirrently used yield results 
which do not correlate highly, hence they do not measure the 
sarae aspects of perf orraance (l8) . Because of this situation, 
it would seem that administrators seldom have sound, objective, 
factual data regarding the performance of their teachers. No 
tX'TO people sec the same thing when observing the teacher. 

Barr (3) and Ryans ( 25 ) foimd that txfo observers simultaneously 
watching the some teacher tend to see and to respond to quite 
different events within the total teaching situation. They con- 
cluded that differences in the observers' value systems had 
determined the differences in perception. If value systems 
differ, it will be highly probable that the purposes or goals 
of the teacher and the organization will be distorted. 
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The application of the evaluation process in schools today 
seems to ignore the evidence that has been accujaulated regard- 
ing the problem of evalua.tion. There seems to be general ac- 
ceptance of the assumptions that Chandler says must bo made 
regardless of the method used. These assumptions arc (a) that 
the qualities and characteristics of an ideal teacher are known, 
(b) that teaching conditions are cither approximately the same 
in different situations or the differences are knoxvn and ade- 
quate adjustments can be made for them, and (c) that the 
evalua.tion instrument is equally reliable when used by different 
individuals and when applied imdor different circumstances (10) « 
There seems to bo an ignoring of the distortion that occurs 
when there is not an a.greemcnt between the administrator and 
the teacher as to the criteria which will be used to judge the 
results achieved. Popham points out that fa.ced with the com- 
plexities resulting from divergent instructional objectives, 
those resca.rchers studying classroom teaching procedures make 
a very critical mistake when they attempt to ferret out sup- 
posedly stiperior instructional procedures that ccLild be used 
with equal efficaxy by different teachers. The quality of 
learning in a given instructional situation is the result of 
instructional procedures employed by a part icular 
instructor for particular students with p_CLnbp._cular goals in 
mind (2l|.) . 
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IV o Contributions to the Field of Evaluation 

Ilany x^3:’oplG in the fields of education, psychology, biisiness, 
and industry have studied and researched the problem of employee 
performance evaluation* Popham maintains that we have not moved 
very far fori-^ard in our efforts to develop reliable measures of 
teacher effectiveness (23) . In this light, it is necessary to 
look at some of the proposals that have been made and to attempt 
to glean from them some threads of continviity or a coriimon denom- 
inator upon which a solution can be based. 

McGregor has proposed a method of appraisa.l that he feels 
has a positive nature (20) . The method is a. shift from appraisal 
to analysis in which the subordinate becomes an active agent, 
not a passive object. The process involves the establishment 
of short term performance goals for himself by the employee 
based on a careful assessment of his own strengths and weak- 
nesses. Together the employee and the administrator formulate 
specific plans for the accomplisliraent of his goals. The admin- 
istrator helps the employee relate his self-appraisal, his 
goals, and his plans to the realities or goals of the organiza- 
tion. The process is culminated by an interview between the 
adrainistra.tor and the employee to examine the employee’s 
so If- appraisal and to plan new goals for the next time period. 

This system places an emphasis on the futvire, not the past, and 
it is based on performance, not personality. T^bstract concepts 
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such as neatness, dependability, adaptability, and initiative 
play a rainor role. This method also reflects McGregor’s belief 
that people have a desire to succeed, that they will i^ork to 
achieve s^^ccess, and that in so doing they ifill exorcise self- 
control, Xijill accept and seek out responsibility, will exercise 
croativit;/ and productivity, and will work diligently to achieve 
corporate goals when they aro provided with social and ego 
satisfactions . 

Flannagan and Burns iDropose a method based on objective 
observation of an employee’s performance followed b;/ discussion 
with the employee of his strengths and weaknesses which can 
contribute to his development (13). The method is called the 
Critical Incidents Method and is based on an analysis of activ- 
ities which are an outstanding contribution to productivity and 
morale or which aro definitely detrimental. Observed and re- 
corded performances based upon the critical requirements for 
the job provide an ideal ba.sis for the oval^lation. The record 
of perforraance is made by the employee himself, and the opinions 
arid judgment of the ovaluator play a minor role in making the 
record because only facts arc recorded. This system was devel- 
oped in an attempt to establish a set of standards which would 
make the result for a particular employee the same no matter 
who did the rating. 

Adams proposes raerit rating for the employees of an organi- 
zation (1). This method requires the development of a good, 
complete job description prepared in cooperation with the em- 
ployee to bo evaluated. Personality traits arc to be completely 



avoided, and porformance is to be evaluated on the basis of the 
achicvonient of established porformance standards. Following 
appraiso.1, the employee has an interview with his superior for 
the pvirpose of discussing the rating, determining reasons for 
poor performance, and developing a. plan of action. 

In the specific area of education, Cariipbcll has proposed 
a process of evaluation which would include (a) selection and 
definition of the particular phase of the total activity to be 
evaluated, (b) definition of criteria or basic assumptions upon 
which interpretations and Judgments will be based, (c) collec- 
tion of data related to the criteria, (d) analysis and interpre- 
tation of the data, and (e) the drawing of conclusions (8). 
Campbell emphasizes that a plan of action, based on the evalua- 
tion, needs to be developed and initiated before the evaluation 
will bo of practical worth. He makes no specific proposal as 
to the exact method of establishing criteria of performance or 
how to measure the results after the performance has been 
observed. 

McNeil lobbies strongly for an evaluation system based on 
the achiovoment of objectives (21). This system is based on 
two assumptions; Learning is evidenced by a chaiige in the be- 
havior of the student, and teaching is successful when the 
instructor's prodotermined and intentional changes sought in 
the learner actually occur. McNeil contends that '•we cannot 
teach what we ennnot specify (21).“ This implies that the 
teacher must select the appropriate changes to bo sought in 
learners and then see that' these changes are prodticed. These 
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assuLiiptlons, therefore, produce the need for the supervisor and 
teacher to agree in advance on what they will accept as evidence 
that the teacher has or has not been successful in changing the 
behavior of the students. If the objectives or goals have been 
forraulated and the criteria for judgment established, there will 
be no ox post facto judgment of ends. Provision is also made 
for the modification of the objectives if the teacher has more 
important changes for the students or has overestimated their 
capacities. This method of evaluation is based upon the ability 
of the teacher to bring about the changes in student behavior 
that he has specified a.s important. The evaluator records a 
factual description of what takes place and collects evidence 
of the extent to xjhich the desired results have occurred. It 
is important that inferences are avoided and that only factual 
data is recorded. This is iii4>ortant to the evaluator becatise 
after evaluation, ho must be able to tell the teacher what to 
modify in his instructional procedures. 

Fawcett proposes that evaluation shoxild be a cooperative 
enterprise between the teacher and the adiiinistrator and that 
there should be a series of signals which both agree e.ro indi- 
cators that the time for evaluation has arrived (12) . Following 
this premise, ho believes that criteria for expertness or in- 
exportness must bo developed according to the nature of the 
goals established and that these criteria vjill servo as the 
indicators for evaluation which will confirm, behavior or load 
to redirection of behavior. Using this idea, Fawcett outlines 
a process of evaluation xdiich includes the following stops ^ 
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(a) rocognition of the need for ovaluation, (b) conforenco bo- 
twGon tho administrator and the employee to establish the nature 
of tho evaluation, (c) securing tho assistance needed to carry 
out tho ovaluation, (d) provision for tho evaluation to be car- 
ried out, and (e) evaluation of the data by the administrator, 
the employee, and the evaluator (12), The important point here 
is the idea that the recognition of one of the signals of suc- 
cess or malfunctioning is the determinant of when the evaluation 
is conducted, not a school district provision requiring eval- 
uation at specific times. 

Prom the above proposals, it seems that several items 
emerge that are necessary for efficient and satisfactory teacher 
evaluation. There must bo agreement between the administrator 
and tho teacher on what is to be judged. The teacher must Imow 
what is expected of him. This agreement should be reached co- 
operatively by the teacher and administrator, and the ovaluation 
should be carried out by those close to the setting of objectives 
or perf orraance standards. The teacher must be a.llox'jed to perform 
using many procedunes to achieve his objectives. It is impera- 
tive that he know how well he is doing, which requires communi- 
cation between the adrainistrator and the teacher. There must 
be provision for the teacher to receive assistance as needed to 
achieve the objectives or goa.ls that have been established co- 
operatively. It also soems impera.tivo that evaluation must bo 
based on performance, not personality. It must bo future 
oriented xfith an emphasis on re]petition of successful teaching 
techniques. It is also im>^ortant that evaluation be continuous 
and cumulative and not be based upon isolated incidents. 
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V. 



Proposal for an Evaluation Tecliniquc 



Using as a basis tlio threads which seera to rim through the 
literature on evaluation, I would like to submit a proposal for 
a system of evaluation. Several questions have to be asked. 

How do wo reinforco desirable bcha.vior in teachers? Kow do we 
redirect uindosirablo behavior? Some assumptions also have to 
bo mc.de. McGregor is correct in his belief that people have a 
desire to succeed, will work to achieve success and in so doing 
will exercise self-control, will seek out responsibility, and 
will work diligently to achieve the goals of the organization 
when provided with social and ego satisfactions. The goals of 
the teacher and the school can be defined and spoiled out in 
terms of pupil behavior changes which can be achieved through 
cooperative effort. The current methods of classroom observa- 
tion based on a time schedule are inappropriate and ineffective. 

The system would be based upon a carefully selected set of 
objectives for the learner to accomplish and upon an assessment 
of the skills, attit^^dGs, and uses of knowledge exhibited by the 
teacher. These objectives would be developed cooperatively by 
the teacher and the administrator. IIcNcil states that when 
there are clear statements of objectives, learning is more ef- 
fective cud objectives are attained more readily. He also assert 
that if there is no agreement on the ends of instruction, there 
can be no agreement regarding appropriate procedures and no fair 
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assessment of teacher effectiveness. Basic to this assertion 
are two assimiptions s (a) Learning is evidenced by a change in 
behavior j and (b) teaching is successful when the instructor’s 
predetermined and intentional changes sought in the learner 
actually occur (21). At this point there must also be agreemont 
between the teacher and administrator as to what would be accepted 
as evidence that the teacher has or has not been successful in 
! reaching the objectives stated in terms of learner behavior. 

The tea.cher must bo aware of the specific skills, attitudes, 
and uses of knox'jledgc Tf/hich will bo essentia.1 to achieving the 
objectives that have been outlined for the students. This is 
an integral part of the evaluation system and must be kept flex- 
ible so that the adrainistrator and tea.cher ma.y a.djust or modify 
any of the throe as the determination of objective may require. 

' A discussion of skills, attitudes, and uses of Imowledge must 
always keep in mind the development of the teacher over a long 
]perlod. Too much a.ttention to short term objectives mCuy not 
allow the teacher to develop his full potential. 

iln important variation from normal proceduj?e is recommended 
at this point. 1 feel that the teacher should now bo allowed 
to perform his role. All possible a.ssistance should be given 
to him in his attempt to achieve the agree upon objectives. 

The supervisor and the teacher become partners in this system; 
therefore, advice is sought and accepted more readily. The 
agreemont in advance of instruction on the objectives to be 
achieved and the evidence which x^ill be o.cccptcd that the toachoi 
has been successful in changing the behavior of students 
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counteract ox post facto jLidgmonts of ends. This results in a 
shift frora jud|;;ins according to procedures followed to judging 
according to the results produced in children. 

It is iraportant to note several problens that raust be con- 
sidered when iriipleiiionting a program of evaluation by student 
achievement of instructional objectives. Bloom points out that 
the original formvilation of objectives is usually ejuite ambig- 
uous. This method of evaluation requires that the objectives 
be stated with sufficient precision that one can determine what 
evidence of student attainment is appropriate (6). It is im- 
perative that as objectives are used and evidence is sought, 
they be modified and clarified so that cva.luation evidence is 
relevant. In this way the objectives are improved and evalua- 
tion becomes more precise. 

Popham reminds that when testing the effects of this pro- 
gram, it is important that the pretests and posttosts based on 
tho operational ob .'ectivos be made sufficiently reliable and 
discriminating to serve the purpose. Ho also points out that 
some teachers may feel genuinely tlireatened by the prospect of 
halving their competence assessed in terms of pupil achievement 
(Eh) . Because of this feeling, there is the possibility of 
opposition to this method of evaluation of teacher effectivenes 



VI. Alternative Methods of Implementation 



At this point it is appropriate to present three alterna- 
tive methods of implementing and conducting evaluation of 
instruction based on prescribed objectives. The three methods 
presented all vary in some degree both in philosophy and in 
organization. A choice araong the alternatives may be made as 
the situation demands. 

Alternative #1 

This alternative is a description of the experience of a 
junior college in developing and implementing this system of 
evaluation. The dean of instruction having made a commitment 
to this method of faculty evaluation was faced with the problem 
of securing volunteer faculty members. The prime ingredient 
was present: strong administrative support. With this support 
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in hand, the dean of instruction sought faculty support. The 
proposal for this type of evaluation was advertised to the fac- 
ulty. Having found foiarteen teachers who volunteered to try 
this system, the dean of instruction developed the following 
proced'ure for getting the system underway: 

(a) A first meeting between the dean of Instruction, the 
division chairman, and a faculty member was held. At 
this meeting several qtiestions were considered: 
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(1) I’/hat do you specifically oxpect jovr students to 
be able to do at the end of your course? 

(2) V/hat do you know about behavioral objectives? 

(b) The faculty inombcr was given instruction in the devel- 
opment of specific instructional objectives by a 
consultant and was assigned reading materials Mager, 
Preparing Instructional Objectives and Bloom, T axongriy 
of Educational Objectives 

(c) A second mooting was held with the doan of instruction, 
the division chairman, and the faculty member a.t which 
time a sot of terminal objectives for a course vxcre 
worked out and agreed upon. Once the objectives were 
cooperatively agreed upon, another important step was 
taken. Criterion x^ere cooperatively established as to 
x-jhat evidence would be accepted that the students had 
met the prescribed objectives. 

(d) A third meeting was held at the end of the year at 
x^hich time the faculty member presented the accxmiu- 
lated evidence that related to the students* success 
or failure of achieving the prescribed objectives. 

At this point, three steps were taken: 

(1) The evidence was examined in terms of the stated 
objectives. 

(2) Modification was made, if necessary, in the 
original objectives. 

(3) An examination X'Tas made of the techniques used in 
guiding the students toward the attainment of the 
objectives if probloms had arisen. 
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The major attraction in this pr>oposal vjcls a way to avoid 
the traditional method of faculty evaluation; classroom visita- 
tion. Several faculty members reported that they were skeptical 
at first for two reasons; (a) suspicion of a now idea that the 
administrators had latched on to and (b) a lack of imder standing 
of the jargon that accompanied the proposal. 

At this point it is important to consider some of the ideas 
that developed in conjunction with the use of this system as 
seen by the administrators and faculty. These ideas are broken 
down by the headings of dean of instruction, division chairman, 
and faculty members. 

Dean of Instruction; 

(a) This system should be implemented one course at a time 
for each instructor involved. 

(b) No attempt should be made to involve all instructors 
at one time. 

(c) Terminal objectives, as defined by Mager and Cohen, 
should be stressed at first and work backward to imit 
objectives . 

(d) In order to influence other faculty members, you have 
to build up this system. Some techniques used were; 

(1) Hake stars of the participants. 

(2) . Use participants in the selection of instruct 5. onal 

equipment and supplies. 

(3) Assign laboratori^ aides to participating 
instructors . 
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(e) There mvist be ultimate responsibility placed on the 
instructor in order to force carry-through of the 
system. 

Division Chairman J 

(a) This system forces the instructor to develop behavioral 
objectives and forces responsibility. 

(b) More frequent evaluation of evidence would be helpful 
in the modification of objectives. 

(c) There should be other means of evaluation for new 
teachers, specifically for those courses not being 
conducted on the basis of instructional objectives. 

Faculty Members: 

(a) This system forces the instructor to define specifi- 
cally what he wants the students to gain from the 
course. 

(b) The most effective influence on non-participants is 
the comments of participating faculty members. 

(c) Mew teachers are the easiest to approach. 

(d) The opportunities for in-service training must be 
utilized. 

A lternative #2 

The method proposed in this a.lternative will closely approx- 
imate the method used in Alternative #1. There is, however, one 
critical difference. Alternative #1 included in its basic frame- 
work a complete absence of classroom visitation. In Alternative 
#2 it is proposed that classroom visitation receive prime 
attention. 
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The basic premise for including classroom visitation in 
this scheme is that it will provide more frequent and rapid feed 
back to the instructor. Banathy proposes that the systems ap- 
proach requires rapid feedback so that outcomes may be checked 
and procedures may be revised in the appropria,te areas (2). 

The visitation method to be used in this alternative is 
one proposed by McNeil (21). It is important to note that this 
procedure must be based upon the recording of factual data and 
a descriptive record of teaching. At no time should judgment 
enter into the recording of what happened in the classroom. To 
this end, McNeil has developed a rating and observation form 
which can be used to record factual data as they relate to the 
agreed upon objectives established by the dean, the division 
chairman, and the instructor. Below is shown the form for 
rating and observation. 



RATING AND OBSERVATlOiM FORM 
1. Agreement upon tentative objectives of instruction 

A. List below the measures, observations, or indicators of 
quality in a pupil’s product (e.g., theme) that vjill be 
accepted as evidence that the teacher is to receive a 
rating of outstanding, good, or poor. (>/hat must pupils 
accomplish in order for the teacher to get a grade of 
outstanding? VJlio.t have the supervisor and teacher agreed 
updn as evidence that pupils have or have not made de- 
sired progress?) 

B. Indicate the kinds of situations to which pupils will be 
expected to respond differently from that response pre- 
sently in their repertoire, (e.g.. Given any Si^anish 
word ending in ar, ]^up.y..s will correctly conjugate the 
verb in the present tense.) 
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Pacts which will be collected for describing the teacher* s 
instructional procedures. 



Principle 



Facts to be collected 



A. 



B. 

C. 

D. 



Re inf or c orient 
(reward systera) 

Indi V i dual i z at i on 

Opportunity to prac- 
tice behavior desired 
Prompting 



Percentage of pupils whose papers 
receive positive comments for 
correct performance. 

Nurabor of alternative assignments 
available to class. 

Number of times each pupil was 
called upon for oral response. 
Examples presented before requir- 
ing learners to generate the rule. 
Number of responses demanded from 
learners without presence of 
teacher prompting or cueing. 



E. Other -- The supervisor may use any principle or theo- 
retical framework that xirill direct attention to factual 
observation in the classroom. 

The utility of the principle is validated when it leads 
to the teacher’s subsequent changing specific aspects 
of instruction and to the consequence of greater pupil 
gain in desired directions. 



The use of this method will accomplish two things of great 
importance: (a) Immediate feedback that is valuable in the 

modification of either the specified objectives or the tech- 
niques used to achieve the desired student behavior changes is 
available to the instructor, and (b) it provides intermediate 
factual checks on the teacher’ s progress toward his goals by a 
competent outside observer. 

Alternative # 3 

This alternative includes a drastic move from the above 
cited methods. The same rationale obtains, but a different 
emphasis is placed on organizing the staff for implementation 
of the evaluation system and on fixing responsibility for stu- 
dent attainment of the cooperatively agreed upon objectives. 
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If tho doan of instruction is dedicated to faculty evaluation 
on tho basis of student achievor.iont of instructional objectives , 
it will be difficult for him to conduct the traditional class- 
room visitation for tli-ose instructors who do not wish to parti- 
cipate. The basic responsibility factor will be set by a 
contractual agreement between the dean of instruction and the 
instructor which establishes the base for evaluation and the 
evidence that will be accepted of student attainment of the ob- 
jectives. To implement this system and to assure tnat all 
instructors vxill be assessed on the same basis, tho students 
will bo given pretests and posttosts and tho results will be 
used as evidence of the effectiveness of the teacher, whether 
or not they are volimtary participants in this type of teacher 
evaluation. 

Popham warns that there is a difficulty in developing pre- 
tests and posttests based on operational objectives which are 
sufficiently reliable and discriminating to serve the purpose 
of teacher evaluation (Plj.) . In view of this warning, it is im- 
portant that groat care go into developing the tests that become 
a basis for teacher evaluation. This warning, however, must not 
keep this method from being tried. The society at largo eval- 
uates the end product of our educational system regardless of the 
evaluation scheme used in the schools. It is imperative, there- 
fore, that teachers who resist placing their competency on the 
line in a new way be forced to do so in some manner so that they 
are judged on the basis of student achievement. 
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The iDarticipating instructors would, imdor this alternative, 
folloi7 the process listed below sta.rting with a. pro-school in- 
service training session. 

(a) First meeting to dotormine what the instructor knows 
about behavioral objectives, to discuss what tho in- 
structor expects his students to be ablo to do upon 
completion of tho course, and to assign reading mater- 
ial on the preparation of instructional objectives. 

(b) Second mvooting to present instruction on the develop- 
ment and use of instructional objectives by a consul- 
tant vjho is experienced in this instructional method. 

(c) Cooperative forraation of terminal instructional ob- 
jectives for each course offered at the college by 
the dean of instruction, the division chairmen, and 
participating instructors. 

(d) Upon completion of the forraation of the ins true tionCtl 

objectives,. development, of protests which are based 
on the specified objectives prior to the opening of 

school. 

(e) Administra.tion of the pretests. 

(f) Cl.assroom visitation of participating instructors for 
the purpose of factual recording of the teacher pro- 
gress toward the student achievement of the objectives 
and the possible raodif ica.tion of objectives or in- 
structional tochniciues. 

(g) Development of posttests which will provide evidence 
of student achievement hnr.od on the proscribed ob- 
jectives. 
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(h) Administration of posttests in order to accuniulato the 
dosired ovidence of strident achieveraent . 

(i) Eval^iation of toachor effectiveness based on tlio results 
of strident scores on the posttest and a discussion of 
possible modifications in objectives, instructional 
techniques, and composition of the protests and posttests, 

This alternative may be a very threatening one to many fac- 
ulty members and administrators who have been conditioned by the 
traditional method of faculty • evaluation. It is observed by 
Popham, hox-jover, that by stipulating identical objectives to be 
achieved out permitting toachor diversity in the means used to 
accomplish these ends, a method of evaluation of teacher per- 
formance is provided without restricting individualistic teaching 
style (2i|) . This provision may allay many of the fears in- 
structors will voice. As to the concern by adrainistrators for 
an intru.sion on their evo.luation domain, they must face the fact 
that research has shoim that the traditional methods of evalua- 
tion produce very little reliable data (3 and 21) and that an 
attempt must be made to secure meaningful data an teacher 
effectiveness. 
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VII. SUIMARY 



If, as Bloom has suggested, education exists for the pur- 
pose of providing experiences that change the thoughts, feelings, 
and actions of students, it is imperative that the objectives of 
education be stated in behavioral terms (6) . Once specified, 
these objectives provide a baseline by which teacher effective- 
ness may be assessed. 

I believe that it is important to sound certain warnings, 
however. It must be kept in mind that the problem of developing 
the most satisfactory instructor evaluation method will not be 
resolved easily. The above described method appears to offer a 
more objective base upon which self-evaluation may be built. 

It allows teacher actions to be seen relative to goal achieve- 
ment, not in relation to personal characteristics. In addition, 
it provides that the establisliment of objectives to be achieved 
and the standards of acceptable performance are to be arrived 
at cooperatively by the teacher and the administrator. 

If these provisions are kept in mind, this method will 
provide better communication between the administrator, the 
instructor, and the students. Built in are ways in which teacher 
behavior may be confirmed or redirected, which leads to the 
achievement of the specified goals. 
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